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INTRODUCTION: 

Increased  breast  density  is  correlated  to  a  4-6  fold  inereased  risk  in  developing  breast 
eancer,  yet  the  physical  and  molecular  mechanisms  are  poorly  understood.  Three- 
dimensional  culture  and  tissue  models  have  previously  shown  to  recapitulate  these 
phenomena  in  vitro,  in  which  an  important  molecular  regulator  is  believed  to  be  Rho- 
related  signaling  pathways  [1].  It  is  our  underlying  hypothesis  that  understanding  the 
spatial  and  temporal  activation  of  Rho  in  the  context  of  the  collagen  matrix  will  help  us 
understand  how  carcinoma  cells  respond  to  the  dense  breast,  and  why  breast  density 
promotes  breast  carcinoma  progression.  This  proposal  is  specifieally  aimed  at  using 
fluoreseence  lifetime  imaging  (FLIM)  eombined  with  multi-photon  microseopy  to 
increase  the  understanding  of  how  Rho-mediated  eontraetility  and  breast  cancer 
progression  are  related.  Fluorescence  signatures  of  breast  epithelial  cells  transfected  with 
GFP  tagged  RhoA  or  Rho  effector  molecules  are  being  studied  for  differences  in 
fluorescence  intensity  and  lifetime,  as  spatial-temporal  indieators  of  the  local  protein 
environment  and  activation  state  of  Rho.  Furthering  the  impaet  of  these  measurements, 
the  appropriate  pairs  of  Rho  and  its  effector  molecules  are  being  made  with  a  seeond 
fluorophore  to  study  protein-protein  interactions  via  FRET-FLIM  methods.  Spectral¬ 
lifetime  imaging  (SLIM)  techniques  are  also  being  used  to  better  distinguish  GFP  signals 
from  intrinsie  sources  of  fluorescence,  such  as  collagen,  NADH  and  FAD.  Successful 
eompletion  of  these  experiments  will  result  in  improved  analysis  approaehes  to 
investigate  intraeellular  signaling  events,  and  advanee  our  understanding  of  the  spatial 
and  temporal  activation  of  Rho  in  dense  collagen  matrices. 

BODY: 

I  am  pleased  to  report  steady  progress  towards  the  three  goals  outlined  in  the  grant  and 
the  original  statement  of  work:  characterization  of  fluoreseence  probes  for  studying  Rho 
activity  in  3D  matrices,  identification  of  changes  in  Rho  signaling  dynamies  within 
different  matrix  densities,  and  aided  development  of  3D  analysis  tools  for  in  vivo  studies. 
Although  we  have  eneountered  both  technological  and  biological  hurdles  that  were  not 
originally  described  in  the  grant,  my  interdisciplinary  training  is  helping  to  address  these 
ehallenges. 

Aiml:  Studying  Rho  activity  in  3D 

For  these  studies,  we  have  been  investigating  Rho  signaling  using  fluoreseenee  reporters. 
Rho  and  one  of  it’s  effectors,  the  Rho  Binding  Domain  (RBD)  of  Rhotekin,  have  been 
tagged  with  EGFP  and  are  stably  expressed  in  3D  cell  culture  models.  Eurthermore, 
through  the  use  of  a  second  fluorophore,  protein-protein  interactions  can  be  studied  by 
means  of  Eluorescenee  Resonance  Energy  Transfer  (ERET).  Near  the  beginning  of  this 
project,  I  had  chosen  to  use  mOrange,  one  of  the  variants  of  red  fluorescent  protein,  as 
the  aceepting  fluorophore  for  EGEP.  T47D  human  breast  carcinoma  cell  lines  (Available 
from  ATCC)  eontaining  donor,  aceeptor,  donor-aeeeptor,  and  free  fluorophore  have  been 
established  by  selecting  through  two  rounds  of  cell  sorting.  Although  the  fluoreseence 
properties  of  mOrange  were  advantageous  over  Red  Eluorescent  Protein  (mREP)  or  its 
variant,  mCherry,  recent  reports  have  deseribed  problems  with  the  use  of  mOrange  in 
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FRET-based  approaches  [2],  We  have  observed  these  same  problems  with  FRET  that  is 
analyzed  via  FLIM  and  feel  mOrange  is  not  the  most  ideal  acceptor  for  EGFP.  The 
problem  is  being  handled  two-fold:  1)  the  probes  are  now  being  constructed  with 
mCherry,  and  2)  proven  intramolecular  Rho-RBD  constructs  are  being  developed  through 
collaboration  with  Klaus  Hahn  at  the  University  of  North  Carolina-Chapel  Hill.  These 
approaches  are  aimed  at  finding  the  most  robust  and  accurate  readout  for  Rbo  activity  in 
3D  collagen  breast  cancer  models,  such  that  all  aims  of  the  initial  proposal  can  be 
fulfilled. 

The  original  proposal  was  aimed  at  understanding  how  breast  cells  respond  to  dense 
matrices  in  the  context  of  morphogenesis.  Another  important  aspect  of  understanding 
breast  cancer  is  invasion  and  migration.  Rbo  activity  is  implicated  in  this  process  as  well, 
so  it  made  sense  to  apply  the  same  probes  to  investigate  tbe  spatial-temporal  dynamics  of 
Rho  activity  in  invasion.  For  this  purpose,  we  turned  to  MDA-MD-23 1  human  breast 
cancer  cells  (Available  from  ATCC),  because  they  are  a  well  characterized  and  highly 
invasive.  Cell  lines  expressing  the  fusion  proteins  are  currently  being  made  and  assays  to 
recapitulate  invasion  have  been  developed. 

Aim2:  Effects  of  matrix  density  on  Rho  activity 

Breast  density  bas  been  implicated  as  a  high  risk  factor  for  developing  breast  cancer,  yet 
little  is  currently  known  of  tbe  associated  molecular  mechanisms.  To  recapitulate  this 
phenomenon  in  vitro,  we  use  model  systems  of  altered  collagen  concentration. 
Background  work,  in  which  the  temperature  of  polymerization  was  systematically 
changed,  has  provided  a  better  understanding  and  characterization  of  recapitulated 
collagen  environments.  Using  fluorescence  and  Second  Harmonic  (SHG)  signals  from 
collagen,  larger  fibers  and  slower  polymerization  kinetics  are  observed  with  a  decrease  in 
temperature  from  37°C  (Figure  1),  as  has  recently  been  reported  [3].  These 
polymerization  conditions  create  differences  in  the  local  and  global  properties,  as  with 
the  shear  and  bulk  moduli,  of  the  matrices.  Importantly,  pronounced  changes  in  the 
cellular  response  to  these  matrix  conditions  have  been  observed.  I  am  now  poised  to 
begin  investigating  Rho  signaling  dynamics  across  density  and  polymerization  conditions 
in  the  context  of  morphogenesis  and  invasion. 


37  27  20 


Figure  1:  Collagen  Type  I  polymerization  at  different  Temperatures;  37, 27  and  20  °C  (Red:  total 
fluorescence,  Green:  Second  Harmonic  filtered  signal.  Yellow:  colocalized  signal). 
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Aim3:  Analysis  techniques  for  multidimensional  signals 


The  analysis  of  intensity  and  lifetime  signatures  is  an  ongoing  challenge  to  interpret, 
compare  and  present  effectively.  The  RBD-GFP  fusion  protein  shows  variable  intensity, 
both  within  and  between  cells,  as  well  as  heterogeneity  of  fluorescence  lifetime,  yet 
intensity  and  lifetime  do  not  exclusively  overlap  with  one  another  (Figure  2).  In  addition 
to  fluorescence  signatures,  the  collagen  SHG  is  being  collected  to  relate  external  stimuli 
based  on  cellular  interactions  with  collagen  to  internal  signal  transduction  events  (Rho 
activation).  Tools  to  study  these  multidimensional  signals  across  dimensions  are  being 
developed  in  collaboration  with  Curtis  Rueden  (lead  software  developer  at  LOCI)  using 
Image  J,  VisBio,  and  SlimPlotter.  The  goal  is  to  create  an  efficient  and  accurate  method 
to  translate  these  high-context  signals  and  analyze  the  signaling  relationships. 

Ultimately,  improving  the  tools  to  better  analyze  all  of  the  signals  together  will  provide 
insight  into  the  regulation  of  Rho  signaling  within  a  3D  environment 


Figure  2:  Analysis  of  RBD-GFP  fluorescence  lifetime  across  2  distinct  z-sections  (top  panels), 
intensity  (middle  panels),  and  visualization  of  separated  GFP  and  SHG  signals  (lower  panels).  Plots 
of  the  lifetime  fit  distributions  show  differences  between  the  sections,  with  collagen  interaction  (Top 
Right).  The  Intensity  lineplot  for  a  line  drawn  across  the  cells  in  the  middle  right  panel  (lower  graph 
to  right)  shows  an  increased  accumulation  of  RBD  at  the  leading  edge  and  variability  between  cells. 
A  combined  analysis  of  these  signals  spatially  is  thought  to  provide  deeper  insight  into  Rho  signaling 
dynamics  in  breast  cancer  initiation  and  progression. 
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KEY  RESEARCH  ACCOMPLISHMENTS: 

-Establishment  of  cell  lines  expressing  reporter  fusion  proteins  for  RhoA  and  Rho 
Binding  Domain  (RBD)  of  rhotekin.  (Rho-GFP;  RBD-GFP) 

-Refining  FRET  biosensor  approach 

-Refining  experimental  design  and  approach  to  include  migration  and  invasion 
-Better  defining  collagen  microenvironment  and  characterizing  cellular  response, 
by  systematically  altering  the  collagen  polymerization  conditions  and  temperature 
-Acquisition  and  analysis  of  multidimensional  signals  from  3D  cellular  breast 
cancer  models. 

-Beginning  to  implement  3D  measuring  and  counting  in  Image!  and  VisBio 

REPORTABLE  OUTCOMES: 

Steve  Trier,  Long  Yan,  Kevin  Eliceiri,  Patricia  Keely.  "Non-linear  imaging  of  Rho  in 
three-dimensional  breast  cancer  models."  The  International  Society  for  Optical 
Engineering,  BIOS  2008,  San  Jose,  California,  January  2008. -Session  Presentation. 

Paolo  Provenzano,  Curtis  Rueden,  Steve  Trier,  Long  Yan,  Suzanne  Ponik,  Patricia  Keely, 
Kevin  Eliceiri.  “Nonlinear  optical  imaging  and  spectral-lifetime  computational  analysis 
of  endogenous  and  exogenous  fluorophores  in  breast  cancer.”  Journal  of  Biomedical 
Optics  13  (3):  031220  (2008). 

CONCLUSION: 

In  this  second  year  I  have  continued  to  refine  the  experimental  and  technical  approaches 
necessary  for  this  proposal's  success.  The  successful  completion  of  the  research  aims  are 
significant  and  the  implications  multifaceted.  This  project  may  help  to  enable  better 
breast  cancer  diagnosis  and  treatments  using  light  microscopy  based  approaches,  as  well 
as  provide  new  tools  for  studying  molecular  signatures  in  tissue  models.  It  is  an  overall 
goal  to  bring  these  approaches  to  the  forefront  of  research  by  helping  make  them  a 
turnkey  technology  here  at  the  LOCI  lab.  I  am  now  poised  to  move  forward  with  the 
original  goal  to  understand  the  spatial-temporal  dynamics  of  Rho  activation  during 
morphogenesis  and  invasion  in  collagen  matrices  of  different  density  and  structure. 
Through  this  project,  we  hope  to  gain  a  better  understanding  into  how  Rho  activity 
contributes  to  a  heightened  risk  of  breast  cancer  with  increased  breast  density. 
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Abstract.  Multiphoton  laser  scanning  microscopy 
(MPLSM)  utilizing  techniques  such  as  multiphoton  excita¬ 
tion  (MPE),  second  harmonic  generation  (SHG),  and  mul¬ 
tiphoton  fluorescence  lifetime  imaging  and  spectral  life¬ 
time  imaging  (FLIM  and  SLIM,  respectively)  are  greatly 
expanding  the  degree  of  information  obtainable  with  op¬ 
tical  imaging  in  biomedical  research.  The  application  of 
these  nonlinear  optical  approaches  to  the  study  of  breast 
cancer  holds  particular  promise.  These  noninvasive,  mul¬ 
tidimensional  techniques  are  well  suited  to  image  exog¬ 
enous  fluorophores  that  allow  relevant  questions  regard¬ 
ing  protein  localization  and  signaling  to  be  addressed  both 
in  vivo  and  in  vitro.  Furthermore,  MPLSM  imaging  of  en¬ 
dogenous  signals  from  collagen  and  fluorophores  such  as 
nicotinamide  adenine  dinucleotide  (NADH)  or  flavin  ad¬ 
enine  dinucleotide  (FAD),  address  important  questions  re¬ 
garding  the  tumor-stromal  interaction  and  the  physiologic 
state  of  the  cell.  We  demonstrate  the  utility  of  multimodal 
MPE/SHG/FLIM  for  imaging  both  exogenous  and/or  en¬ 
dogenous  fluorophores  in  mammary  tumors  or  relevant 
3-D  systems.  Using  SLIM,  we  present  a  method  for  imag¬ 
ing  and  differentiating  signals  from  multiple  fluorophores 
that  can  have  overlapping  spectra  via  SLIM  Plotter — a 
computational  tool  for  visualizing  and  analyzing  large 
spectral-lifetime  data  sets.  ®  zoos  Society  of  Photo-Optica!  instru¬ 
mentation  Engineers.  [DOI:  10.1117/1.2940365] 

Keywords:  endogenous  fluorescence;  multiphoton  microscopy;  sec¬ 
ond  harmonic  generation;  fluorescence  lifetime  imaging  microscopy; 
spectral  lifetime  imaging  microscopy. 
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1  Introduction 

Breast  cancer  is  a  devastating  disease  accounting  for  ~15% 
of  all  female  cancer-related  deaths  in  the  United  States  and  is 
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the  most  prevalent  cancer  among  women.*  Therefore,  tech¬ 
nologies  to  detect,  classify,  study,  and  combat  breast  cancer 
are  of  great  significance.  Among  these  technologies,  optical 
Imaging  modalities  have  helped  facilitate  advances  in  cancer 
diagnosis  as  well  as  aid  in  studies  aimed  at  understanding  the 
mechanisms  associated  with  cancer  formation  and  progression 
(reviewed  in  Refs.  2  and  3).  Often,  relevant  questions  regard¬ 
ing  complex  cell  signaling  events  and  physiological  processes 
can  only  be  well  understood  by  imaging  temporal  molecular 
localization  events  and  other  subcellular  processes  in  cells  in 
their  engineered  or  native  environment.  As  such,  nonlinear 
optical  imaging  techniques  based  on  multiphoton  excitation 
have  emerged  as  powerful  tools  to  noninvaslvely  image  cel¬ 
lular  processes  both  in  vitro  and  in  vivo.**”'* 

Multiphoton  laser  scanning  microscopy  (MPLSM),  first  re¬ 
ported  by  Denk  and  colleagues,*  is  an  optical  sectioning  tech¬ 
nique  that  allows  thick  biological  sections  to  be  Imaged  via 
absorption  of  two  or  more  low-energy  photons  (typically  700 
to  1050  nm).  For  this  reason,  the  effective  imaging  depth  can 
greatly  exceed  conventional  confocal  microscopy,*’*^  while 
reducing  photo  damage  and  maintaining  superior  viability  fol¬ 
lowing  prolonged  exposure.**  As  a  result  of  these  characteris¬ 
tics,  the  use  of  multiphoton  imaging  technology  is  increasing, 
which  has  facilitated  the  emergence  of  two-photon  second 
harmonic  generation  (SHG)  imaging  of  biological 
structures,*”*’***’*^  multiphoton  fluorescence  lifetime  imaging 
microscopy  (FLIM;  Refs.  15-18),  and  multiphoton  spectral 
lifetime  Imaging  microscopy  (SLIM;  Refs.  19  and  20).  Hence, 
when  utilized  individually,  and  particularly  In  combination, 
these  advances  provide  tools  to  obtain  detailed  multidimen¬ 
sional  data  from  cells  containing  exogenous  and/or  endog¬ 
enous  fluorophores. 

Engineering  of  proteins  tagged  with  exogenous  fluoro¬ 
phores,  such  as  Green  Fluorescent  Protein  (GFP)  and  DsRed 
(and  their  variants),  has  greatly  expanded  our  knowledge  of 
fundamental  intracellular  processes  affording  unparalleled  in¬ 
sight  into  protein  localization,  interactions,  and  temporal  dy¬ 
namics  (reviewed  in  Refs.  21-23).  In  particular,  recent  ad¬ 
vances  using  exogenous  fluorophores  to  generate 
(fluorescence  resonance  energy  transfer  (FRET))  are  provid¬ 
ing  new  information  about  complex  signaling  events  within 
cancerous  cells.*"*’**  However,  imaging  complex  systems  and 
multiple  fluorophores  presents  certain  obstacles.  One  such  dif¬ 
ficulty  arises  from  overlapping  spectra  and  background  sig¬ 
nals  from  endogenous  fluorophores.  Yet  endogenous  fluoro¬ 
phores  can  also  provide  useful  structural  information  about 
the  interaction  of  a  cell  with  its  microenvironment*"*’**”**  and 
the  condition  of  the  cell.*^”**  For  instance:  (1)  endogenous 
SHG  signals  from  collagen  have  provided  fundamental  infor¬ 
mation  regarding  the  tumor  cell’s  interaction  with  the  stroma 
during  invasion  and  metastasis,*"*’**  (2)  the  metabolic  state  of 
carcinoma  cells,  as  detected  by  endogenous  fluorophores  that 
are  metabolic  intermediates,  has  been  correlated  to  metastatic 
potential,**  and  (3)  diagnosis  of  human  cancer  by  examining 
endogenous  fluorophores  has  been  an  active  area  of  research 
for  many  years  (see  Refs.  32-35  and  references  therein). 
Therefore,  imaging  endogenous  fluorophores  in  breast  cancer 
tissue  can  provide  biologically  meaningful  information,  and 
the  ability  to  account  for  endogenous  fluorescence  when  Im¬ 


aging  exogenous  or  combined  exogenous/endogenous  fluoro¬ 
phores  is  very  practical. 

In  breast  tissue,  the  most  dominant  endogenous  fluoro¬ 
phores  imaged  with  MPLSM  are  tryptophan,  nicotinamide  ad¬ 
enine  dinucleotide  (NADH)  and  flavin  adenine  dinucleotide 
(FAD),  as  well  as  endogenous  SHG  signals  from  collagen. 
Each  of  these  fluorophores  has  a  unique  excitation/emission 
spectra  in  the  UV  and  visible  light  regimes  that  allows  imag¬ 
ing  of  cellular  morphology  and  organelles  (such  as  mitochon¬ 
dria),  as  well  as  providing  information  about  the  metabolic 
state  of  the  cell.  The  excitation/emission  maxima  of  these 
fluorophores  are  ~280/340nm  for  tryptophan, 
-340/450  nm  for  NADH,  and  -450/530  nm  for  FAD***’**; 
two-photon  SHG  from  collagen  is  a  nonfluorescent  event  re¬ 
sulting  from  the  laser  field  suffering  a  nonlinear,  second-order 
polarization  when  passing  through  a  noncentrosymmetric  or¬ 
dered  structure,  and  as  such,  SHG  signals  are  at  exactly  half 
the  excitation  wavelength.*’**”**  Although  the  spectra  of  these 
strong  endogenous  signals  are  reasonably  distinct,  there  is 
overlap  and  they  are  not  distinct  from  the  exogenous  fluoro¬ 
phores  most  commonly  utilized  with  MPLSM.  Therefore,  in 
order  to  distinguish  emission  signals  or  correct  for  back¬ 
ground  contamination,  filtering  techniques  may  be  employed 
to  isolate  portions  of  the  emission  spectra.  However,  this  re¬ 
quires  an  a  priori  knowledge  of  the  fluorophores  that  may  not 
always  be  practical.  Another  approach  is  to  utilize  multipho¬ 
ton  FLIM,  where  the  excited  state  lifetimes  of  the  fluoro¬ 
phores  are  analyzed  to  potentially  identify  fluorophores  with 
significantly  overlapping  spectra.  However,  the  excited  state 
lifetime  of  a  molecule  is  microenvironment  dependent,  with 
factors  such  as  pH,  oxygen  concentration,  temperature,  bind¬ 
ing  to  macromolecules,  and  FRET  states  all  potentially  modi¬ 
fying  the  lifetime  of  a  particular  fluorophore.*^  Therefore,  it  is 
desirable  to  obtain  spectral  information  combined  with  fluo¬ 
rescence  lifetime  data  to  facilitate  imaging  of  multiple  fluoro¬ 
phores  within  a  cell  or  tissue.  To  achieve  this  goal,  our  re¬ 
search  group  has  developed  a  combined  multiphoton  spectral 
and  lifetime  microscope*®’"***  for  SLIM  that  simultaneously 
collects  fluorescence  lifetime  data  from  16  separate  10-nm- 
width  spectral  channels.  Using  this  system,  we  are  able  to 
collect  data  from  spectrally  overlapping  fluorophores  and  iso¬ 
late  signals  of  Interest  from  contaminating  signals.  In  this  pa¬ 
per,  we  will  present  data  demonstrating  the  utility  of 
MPLSM-based  technologies  to  image  endogenous  signals  and 
the  combination  of  exogenous  and  endogenous  signals  with 
particular  emphasis  on  spectral  lifetime  imaging,  and  the 
computational  tools  we  have  developed  to  visualize  and  ana¬ 
lyze  complex  spectral  lifetime  data  sets. 

2  Methods 

2.1  Cell  Culture 

T47D  cells  were  obtained  from  the  American  Type  Culture 
Collection.  NMuMG  cells  were  a  kind  gift  from  Dr.  Caroline 
Alexander  (University  of  Wisconsin).  EGEP-Vinculin  was  a 
kind  gift  from  Dr.  Anna  Huttenlocher  (University  of  Wiscon¬ 
sin).  For  GFP-RBD,  the  Rho  binding  domain  (RBD)  of  Rho- 
tetkin  was  excised  from  GFP-RBD  (a  generous  gift  of  Dr.  Bill 
Bement,  University  of  Wisconsin),  subcloned  into  pEGFP-Cl 
(Clontech),  and  stably  expressed  in  T47D  breast  carcinoma 
cells.  T47D  human  breast  cells  were  maintained  in  RPMI 
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supplemented  with  10%  fetal  bovine  serum  and  insulin. 
NMuMG  mouse  mammary  cells  were  maintained  in  DMEM 
supplemented  with  insulin  and  10%  fetal  bovine  serum.  Both 
cells  lines  were  cultured  at  37  °C  with  5%  CO2. 

Cells  were  cultured  and  imaged  under  standard  2-D  condi¬ 
tions  or  within  3-D  collagen  matrices.  For  3-D  culture,  cells 
were  cultured  within  a  1.0  to  4.0  mg/mL  type-1  collagen  gel 
(rat-tail  collagen  solution,  BD  Biosciences)  neutralized  with 
100  mM  HEPES  in  2X  PBS.  Following  gel  polymerization, 
gels  were  soaked  in  cell-specific  media  (described  earlier)  or 
serum-free  media  containing  BSA  and  maintained  at  37  °C 
with  10%  CO2  until  imaged  as  described  in  the  text. 

2.2  Mammary  Tumors 

All  animal  experiments  were  approved  by  the  institutional 
animal  use  and  care  committee  and  meet  NIH  guidelines  for 
animal  welfare.  To  generate  mammary  tumors,  polyoma 
middle-T  mice^**  were  employed.  For  MPLSM  imaging  of 
live,  unfixed,  intact  (not  sectioned),  nonstained  PyVT  tumors, 
tumors  were  harvested  and  live  tissue  maintained  in  buffered 
media  at  37 °C.  All  tissues  were  imaged  immediately  follow¬ 
ing  tissue  harvest. 

2.3  Instrumentation 

For  all  imaging,  two  different  custom  multiphoton  systems 
that  are  part  of  the  University  of  Wisconsin  Laboratory  for 
Optical  and  Computational  Instrumentation  (LOCI, 
www.loci.wisc.edu)  were  utilized. The  first  system  is  an 
MPLSM  workstation  constructed  around  a  Nikon  Eclipse 
TE300  that  facilitates  multiphoton  excitation  (MPE),  SHC, 
and  FLIM.  All  SHC  imaging  was  performed  on  this  micro¬ 
scope  and  was  detected  from  the  backscattered  SHC  signal.^* 
A  5-W  mode-locked  Ti:Sapphire  laser  (Spectra-Physics- 
Millennium/Tsunami)  excitation  (laser  field)  source  producing 
around  100-fs  pulse  widths  was  tuned  to  780  to  900  nm.  The 
beam  was  focused  onto  the  sample  with  a  Nikon  CFI  Plan 
Fluor  20X  multi-immersion  objective  (NA  of  0.75  and  WD  of 
0.33  with  water),  a  Nikon  CFI  Plan  Fluor  40X  oil  immersion 
lens  (NA=L3),  or  a  Nikon  CFI  Plan  Apo  60X  water- 
immersion  lens  (NA=L2).  Endogenous  fluorescence  and 
SHC  signals  were  isolated  with  464-nm  (cut-on)  long-pass 
and  445-nm  narrow  bandpass  filters,  while  CFP  signals  were 
isolated  with  a  480  to  550  nm  (bandpass)  filter  (all  filters:  TFI 
Technologies,  Creenfield,  Massachusetts).  Intensity  and  FLIM 
data  were  collected  by  a  H7422  CaAsP  photon  counting  pho¬ 
tomultiplier  tube  (PMT)  (Hamamatsu)  connected  to  a  time- 
correlated  single  photon  counting  (TCSPC)  system  (SPC-730, 
Becker  &  Hickl). 

The  second  microscope  has  been  recently  described  in 
detail  and  allows  generation  of  multiphoton  excitation 
intensity  images  in  conjunction  with  FLIM  and  SLIM.  In 
short,  the  system  is  built  around  an  inverted  microscope  (TE 
2000,  Nikon,  Melville,  New  York)  with  source  illumination 
from  a  Ti: Sapphire  mode-locking  laser  (Coherent  Mira,  Co¬ 
herent,  Santa  Clara,  California),  with  a  tuning  range  of  ~700 
to  1000  tun.  FLIM  images  were  acquired  with  an  electronic 
system  for  recording  fast  light  signals  by  time-correlated 
single  photon  counting  (SPC-830,  Becker  &  Hickl).  The  sys¬ 
tem  has  several  detectors,  including  a  16-channel  combined 
spectral  lifetime  detector  (utilizes  a  Hamamatsu  PML-16 


PMT),  detection  range  350  to  720  nm,  and  an  H7422P 
CaAsP  photon  counting  PMT  (Hamamatsu)  for  intensity  and 
lifetime  imaging.  The  same  lenses  and  filters  were  used  as  on 
the  first  microscope  system.  Both  FLIM  and  SLIM  data  were 
collected  over  60  s,  and  the  pixel  frame  size  for  the  MPE/ 
SHC  images  is  1024  X  1024,  while  the  FLIM  and  SLIM  im¬ 
ages  are  256  X  256. 

Acquisition  for  both  MPLSM  systems  was  performed  with 
WiscScan,^'^  a  LOCI-developed  software  acquisition  package 
that  can  control  both  the  MPLSM  and  the  lifetime  collection. 
Image  analysis  was  performed  with  ImageJ"*"*  and  VisBio^^ 
software.  Fluorescent  lifetime  analysis  was  carried  out  with 
SPCImage  (Becker  &  Hickl),  which  can  fit  fluorescent  decay 
data  to  an  exponential  function  [Eq.  (1)],  for  one,  two,  or 
three  terms,  and  sum  individual  photon  counts  for  each  pixel 
to  construct  a  contrast  image.  The  incomplete  model  approach 
in  SPCImage  was  used  to  compensate  for  instances  where  the 
fluorescence  decay  is  slow  compared  to  the  time  window  de¬ 
fined  by  the  repetition  rate  of  the  laser  system.  SLIM  analysis 
was  performed  with  SPCImage  (Becker  &  Hickl)  and  SLIM 
Plotter  (described  in  detail  in  Sec.  3). 

3  Results  and  Discussion 

3.1  Nonlinear  Optical  Imaging:  MPE,  SHC,  FLIM, 
and  SLIM 

Increased  understanding  of  tumor-stromal  interactions  is  a 
critical  aspect  of  the  study  of  breast  tumor  formation  and  pro¬ 
gression,  since  stromal-epithelial  interactions  play  a  critical 
role  in  both  tumorigenesis  and  metastasis.  Since  op¬ 

tical  imaging  modalities  allow  deep,  noninvasive  imaging  of 
epithelial  and  stromal  components  of  live  breast  tissue  and 
tumors,  they  provide  a  valuable  set  of  tools  to  better  under¬ 
stand  the  tumor-stromal  interaction.  As  seen  in  Fig.  1,  multi¬ 
modal  multiphoton  excitation  (MPE)/SHC  imaging  offers  a 
clear  view  of  intact  live  mammary  tumor  tissue.  Not  only  can 
epithelial  and  stromal  cells  be  clearly  seen,  but  their  interac¬ 
tion  with  the  stromal  collagen  matrix  can  also  be  readily  im¬ 
aged.  By  taking  advantage  of  the  fact  that  SHC  signals  are 
exactly  half  of  the  excitation  wavelength,  while  fluorophores 
under  MPE  excitation  obey  the  fundamental  physical  relation¬ 
ship  of  energy  loss  after  excitation  (Stokes  shift),  the  MPE 
and  SHC  signals  can  be  separated  by  filtering  the  emission 
signal.  In  Fig.  I,  live  mammary  tumor  tissue  was  excited  at 
890  nm  to  produce  endogenous  fluorescence  from  tumor  and 
tumor-associated  cells  and  SHC  from  collagen.  (In  our  hands, 
with  our  biological  systems,  this  wavelength  has  provided  the 
strongest  SHC  signal  for  collagen.)  To  separate  the  emission 
signals,  a  464-nm  (cut-on)  long-pass  filter  was  used  to  isolate 
the  cellular  fluorescence  (MPE  signal),  while  SHC  was  iso¬ 
lated  with  a  445-nm  narrow  bandpass  filter.  By  performing 
this  filtering  scheme,  the  tumor  cell’s  interaction  with  col¬ 
lagen  can  be  studied.  Consequently,  the  use  of  combined 
MPE/SHC  has  the  ability  to  identify  and  differentiate  features 
that  are  either  not  obtainable  or  not  easily  obtained  with  more 
traditional  fluorescence  microscopy  techniques.  For  instance, 
using  this  approach,  we  previously  defined  three  tumor- 
associated  collagen  signatures  (TAGS;  Ref.  14)  in  mammary 
tumors  by  imaging  stromal  collagen  density  and  organization 
within  and  around  tumors  of  varying  stages.  These  TAGS  are 
diagnostic,  allowing  identification  of  early  neoplastic  regions 
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Fig.  1  MPE/SHG  imaging  of  live  tumor  tissue.  Combined  (a)  and  sepa¬ 
rated  (b)  MPE/SHG  images  acquired  following  kg„=890  nm  of  live 
mammary  tumor  tissue.  Combined  MPE/SHG  clearly  demonstrates  the 
ability  to  image  deep  into  live  tissue  and  obtain  meaningful  informa¬ 
tion  from  endogenous  signals.  In  (b),  emission  signals  were  isolated 
with  a  464-nm  (cut-on)  long-pass  filter  for  MPE  (pseudocolored  red) 
and  a  445-nm  narrow  bandpass  filter  SHG  (pseudocolored  green). 
This  approach  permits  identification  of  epithelial  tumor  cells,  tumor- 
associated  stromal  cells,  and  the  collagen  matrix.  As  such,  combined 
MPE/SHG  imaging  of  intact  tumors  can  provide  relevant  information 
about  the  cell-matrix  interaction  and  how  matrix  density  and  organi¬ 
zation  influence  cell  behavior.  Bar  =  25  /xm. 

as  well  as  signatures  that  identify  invading  metastatic  cells.*'* 
TACS-1  characterizes  the  presence  of  increased  SHG  signal 
intensity  due  to  increased  locally  dense  collagen  within  the 
globally  increased  collagen  concentration  surrounding  tumors, 
serving  as  a  reliable  hallmark  for  locating  small  neoplastic 
regions.  TACS-2  classifies  straightened  collagen  fibers 
stretched  around  the  tumor,  constraining  the  tumor  volume 
and  indicating  that  the  tumor  has  substantially  expanded  and 
is  straining  the  space  of  its  microenvironment.  TACS-3  is  the 
identification  and  characterization  of  radially  aligned  (distrib¬ 
uted  at  approximately  90  deg  relative  to  the  tumor  boundary) 
collagen  fibers  that  facilitate  local  invasion,  and  support  evi¬ 
dence  presented  by  Condeelis  and  colleagues  that  metastasiz¬ 
ing  tumor  cells  migrate  along  collagen  fibers. 

Multiphoton  FLIM  provides  an  additional  data 
dimension — allowing  the  measurement  of  the  fluorescence 
lifetimes  of  endogenous  fiuorophores  within  normal  and  tu¬ 
mor  cells  while  simultaneously  identifying  collagen  in  and 


Fig.  2  FLIM  imaging  of  live  mammary  tumor  tissue.  Tumors  were  im¬ 
aged  at  Xj,,(=780  nm  [(a)  and  (b)]  and  Xj,,(=890  nm  [(c)  and  (d)]  to 
produce  endogenous  fluorescence  from  NADH  and  FAD,  respec¬ 
tively.  Intensity  [(a)  and  (c)]  and  color-mapped  lifetime  [(b)  and  (d)] 
images  are  shown.  Color  mapping  represents  the  weighted  average  of 
the  mean  lifetime  (t„,)  (Eq.  (2))  following  fitting  with  a  two-term  ex¬ 
ponential  model  [Eq.  (1)].  Note  that  emission  from  collagen  (d)  maps 
to  the  yellow  end  of  the  spectrum,  indicating  SHG. 

around  the  tumor  by  exploiting  the  fact  that  the  collagen  sig¬ 
nal  is  not  fluorescent  and  as  such  has  a  theoretical  lifetime  of 
zero.  Figure  2  demonstrates  the  utility  of  multiphoton  FLIM 
in  identifying  and  measuring  lifetimes  of  the  relevant  meta¬ 
bolic  components  NADH  and  FAD,  as  well  as  identifying 
collagen.  To  characterize  and  present  lifetime  information,  the 
data  was  fit  with  a  multiexponential  model: 

n 

Ifif)  =  2  tt,  exp(-  f/r,)  +  c  =  ai  exp(-  t/Tj)  +  a2  exp(-  tlT2) 

i=Q 

-E  dj  exp(- f/Tj) -E  •••  .  -EC,  (1) 

where  a  is  the  fractional  contribution  of  each  of  the  compo- 
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Fig.  3  Imaging  mammary  ductal  structure  in  reconstituted  3-D  matrices.  Nontransformed  NMuMG  mammary  cells  were  cultured  within  a  3-D 
collagen  matrix  (3.0  mg/mL)  for  7  days  to  demonstrate  the  ability  of  combined  MPE/SHG/FLIM  to  study  cellular  differentiation  and  the  extracellular 
microenvironment.  The  recapitulated  ductal  structure  can  be  seen  with  transmitted  light  (a),  but  use  of  combined  MPE/SHG  (b)  and/or  multiphoton 
FLIM  (c)  provides  information  regarding  the  collagen  matrix  and  the  physiologic  state  of  the  cells.  In  (c),  color  represents  the  weighted  average 
following  a  two-term  exponential  fit  as  described  in  Fig.  2.  Scale  bar=25  ^m;  color  bar  0.08  to  1.0  ns  (red  to  blue). 
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Video  1.  Movie  of  a  transmitted  light  z-stack  (200  ^m),  showing 
mammary  ductal  structure  with  a  reconstituted  3-D  matrix  (Quick¬ 
Time,  2.7  MB).  [URL:  http://dx.doi.Org/10.1117/l.2940365.1]. 

nents,  t  is  the  fluorescence  lifetime,  and  c  is  background  light 
noise.  By  examining  the  relative  contributions  of  the  lifetime 
components  as  well  as  their  value,  it  may  be  possible  to  iden¬ 
tify  a  particular  fluorophore  or  gain  an  understanding  about 
biological  processes  that  are  influencing  a  fluorophore.  In  Fig. 
2,  the  data  are  presented  as  a  weighted  average  of  a  two- 
component  lifetime  fit: 

7',„  =  (ain+«2^2)/{«i  +  «2)-  (2) 

Hence,  FLIM  can  help  identify  different  fluorophores,  with 
the  caveat  that  absolute  identification  of  the  source  fluoro¬ 
phore  is  not  certain.  However,  with  the  addition  of  spectral 
information,  much  stronger  conclusions  regarding  the  emis¬ 
sion  source  can  be  obtained  (see  the  following). 

In  addition  to  the  ability  to  image  live  tissues,  studies  in 
more  reductionist  in  vitro  systems  that  reconstruct  aspects  of 
the  cell’s  microenvironment,  such  as  reconstituted  3-D  matri¬ 
ces,  can  provide  valuable  information  regarding  cell  pheno¬ 
type  and  signaling  events.  Figure  3  demonstrates  the  ability  of 
mammary  epithelial  to  recapitulate  ductal  structure  when  cul¬ 
tured  under  the  appropriate  conditions  within  a  collagen  ma¬ 
trix,  supporting  the  concept  of  this  system  as  a  valuable 
method  to  study  breast  epithelia.  Although  transmitted  light 
[Fig.  3(a);  Video  1]  provides  information  regarding  the  mor¬ 
phology  of  the  cells  and  allows  visualization  of  the  ductal 
structure,  little  information  can  be  obtained  regarding  the  cel¬ 
lular  interaction  with  the  microenvironment.  By  exciting  sig¬ 
nals  from  endogenous  sources,  insight  into  this  interaction  can 
be  gained.  Combining  MPE  excitation  of  endogenous  fluoro¬ 
phores  with  SHG  imaging,  a  more  complete  view  of  the  struc¬ 
ture  and  its  interactions  can  be  obtained  [Fig.  3(b);  Video  2]. 
Furthermore,  multiphoton  FLIM  can  be  utilized  as  described 
earlier  to  acquire  lifetime  data  that  can  identify  the  metabolic 
state  of  the  cell  or  isolate  and  characterize  fluorophores 
present  with  and  around  the  cells.  This  is  of  even  greater 
utility  when  the  desired  goal  is  to  image  both  exogenous  and 
endogenous  signals  simultaneously,  such  as  is  the  case  for 
protein  localization  (Fig.  4)  or  FRET  experiments  within  3-D 
collagen  environments.  As  seen  in  Fig.  4,  combined  MPE/ 


Video  2.  Pseudocolored  movie  of  a  combined  MPE/SHG  z-stack 
(200  /xm),  showing  ductal  structure  and  the  surrounding  collagen  mi¬ 
croenvironment  (QuickTime,  4.49  MB). 

[URL:  http://dx.d0i.0rg/l  0.111  7/1 .2940365.2]. 


SHG  imaging  allows  a  clear  view  of  the  cell-matrix  interac¬ 
tion  in  3-D.  GFP  emissions  from  GFP-Vinculin  were  sepa¬ 
rated  using  a  480-  to  550-nm  (bandpass)  filter,  while  SHG 
was  isolated  with  a  445-nm  narrow  bandpass  filter.  Three- 
dimensional  matrix  adhesion  to  the  collagen  matrix  can 
clearly  be  seen  (see  Fig.  4,  inset)  allowing  a  reconstruction  of 
cell  morphology,  collagen  organization,  and  the  cell-matrix 
interface.  However,  in  more  complex  studies,  such  as  FLIM, 
the  presence  of  a  strong  SHG  signal  (or  other  endogenous  or 
exogenous  signal)  in  close  proximity  to  the  fluorophore  can 
be  very  problematic.  Moreover,  while  FRET  measured  with 
FLIM  can  be  superior  to  intensity-based  FRET  measurements 
due  to  the  fact  that  FLIM  is  independent  of  fluorophore  con¬ 
centration,  FLIM  is  susceptible  to  multiple  signal  contamina¬ 
tion  issues  in  data  analysis,  particularly  when  more  than  two 
lifetime  components  are  potentially  present.  This  can  be  over¬ 
come  by  employing  spectral  lifetime  imaging,  as  discussed 
earlier.  By  separating  the  spectral  signal  of  interest  from  con¬ 
taminating  background^*  or  other  fluorophores  of  interest,  the 
lifetime  of  the  fluorophore  of  interest,  can  be  cleanly  obtained 
(Fig.  5).  However,  in  order  to  efficiently  analyze  the  large 
multidimensional  data  sets  from  SLIM,  a  computational  infra¬ 
structure  needs  to  be  developed.  As  a  means  to  effectively 
visualize  and  exploit  the  information  from  spectral  lifetime 
data,  we  have  developed  a  novel  computational  package. 

3.2  Combined  Spectral  Lifetime  Visualization: 

SLIM  Plotter 

Slim  Plotter  is  a  lightweight  application  for  the  visualization 
of  combined  spectral  lifetime  data  (Fig.  6).  The  main  purpose 
of  the  program  is  to  allow  exploration  of  regions  of  data  col¬ 
lected  with  an  SLIM  system,  but  the  software  also  provides 
some  features  to  assist  hardware  engineers  in  proper  calibra¬ 
tion  of  the  acquisition  hardware. 

The  program  is  written  in  Java,  which  enables  cross¬ 
platform  deployment.  Launchers  are  provided  for  Microsoft 
Windows  (EXE  file),  Mac  OS  X  (application  bundle),  and 
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Fig.  4  Imaging  3-D  matrix  adhesions  with  MPE/SHG.  Combined  MPE/ 
SHC  imaging  at  X.j,x=f590  nm  of  GEP-Vinculin  expressing  NMuMG 
cells  within  a  3-D  collagen  matrix  (4.0  mg/mL)  for  7  days  allows  a 
clear  view  of  collagen  matrix  organization,  vinculin  localization,  and 
the  cell-matrix  interaction.  Emissions  signals  from  GEP  were  isolated 
with  a  480  to  550-nm  (bandpass)  filter  (pseudocolored  red)  and  a 
445-nm  narrow  bandpass  filter  SHG  (pseudocolored  green).  Three- 
dimensional  matrix  adhesion  to  the  collagen  matrix  can  clearly  be 
seen  (inset).  Bar=25  ju,m. 


*nix  (shell  script).  It  uses  the  VisAD  Java  visualization  toolkit 
for  displaying  data  (http;//www.ssec. wisc.edu/ 

~billh/visad.html),  which  in  turn  uses  JavaSD  (https:// 
java3d.dev.java.net/).  Slim  Plotter  requires  Java  version  1.4 
and  Java3D  1.3 — these  versions  come  bundled  with  Mac  OS 
X,  so  Slim  Plotter  should  work  out  of  the  box  on  Apple  com¬ 
puters,  while  Windows  and  Linux  users  must  set  up  the  Java 
runtime  environment  and  Java3D  if  they  do  not  already  have 
them  installed.  Although  memory  requirements  vary  depend¬ 
ing  on  the  size  of  the  data  set,  at  least  512  MB  of  system 
RAM  is  strongly  recommended.  See  the  Slim  Plotter  website 
(http://www.loci.wisc.edu/ome/slim.html)  for  download  and 
detailed  installation  instructions. 

3.2.1  Features 

Slim  Plotter  is  designed  to  be  a  simple  yet  effective  tool.  The 
main  interface  fits  into  one  window,  with  two  displays — a  2-D 
intensity  view  and  a  3-D  surface  view — plus  visualization  op¬ 
tions  and  a  log  window  to  report  numerical  results  and  errors. 

3.2.2  Reading  data 

Slim  Plotter  uses  the  LOCI  Bio-Formats  I/O  library  (http:// 
www.loci.wisc.edu/ome/formats.html)  to  read  the  proprietary 


Fig- 5  SLIM  to  optimize  exogenous  and  endogenous  signals,  (a)  MPE/SHG  intensity  image  of  seven  T47D  breast  cells  (each  designated  by  a  star), 
composing  a  developing  ductal  tubule  within  a  3-D  collagen  matrix  (1.3  mg/mL)  after  5  days  in  culture.  Each  cell  expresses  various  levels  of 
EGEP-Rhotekin  binding  domain  (GEP-RBD)  and  therefore  has  different  intensity  in  the  MPE  image,  (b)  An  ELIM  image  demonstrates  collagen  fibers 
in  juxtaposition  to  localized  GEP-RBD.  Arrows  demonstrate  regions  of  localized  RBD,  suggesting  local  Rho  GTPase  activation.  Note  that  Rho  is 
activated  at  "stress"  points  where  the  forming  tubule  contacts  collagen  fibers,  which  is  biologically  quite  interesting  but  can  make  data  analysis  and 
interpretation  difficult.  Therefore,  the  spectral  channels  for  GEP  [see  the  SLIM  Plotter  output  in  (d)]  were  selectively  reimaged,  producing  a  new 
SLIM  image,  and  were  color  mapped  with  a  narrower  lifetime  scale  (c).  This  allows  elimination  of  the  collagen  signal  when  desired  and  shows 
additional  localization  of  GEP-RBD.  Hence,  spectral  lifetime  imaging  has  the  ability  to  facilitate  separation  of  signals  of  interest  for  analysis  or 
elimination  when  the  large  data  set  can  be  efficiently  managed  and  visualized  (see  Sec.  3.2).  Bar=20  fj.m. 
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Fig.  6  SLIM  Plotter  Visualization  window.  Example  of  the  SLIM  Plotter  Visualization  window.  Data  used  for  this  example  is  from  a  mammary  tumor, 
and  the  image  shown  in  the  2-D  viewer  is  a  single  spectral  channel. 


SDT  data  files  that  the  Becker  &  Hickl  FLIM  acquisition 
boards  utilize.  It  supports  data  of  any  feasible  image  reso¬ 
lution,  with  any  number  of  lifetime  bins  and  spectral  chan¬ 
nels,  including  single-channel  lifetime  data.  It  automatically 
extracts  the  data  set’s  dimensionality  (image  width,  image 
height,  lifetime  bin  granularity,  and  number  of  spectral  chan¬ 
nels)  from  the  SDT  file,  but  allows  the  user  to  override  these 
values  if  they  were  stored  incorrectly  within  the  file.  Some 
values,  particularly  the  physical  width  of  the  lifetime  histo¬ 
gram  in  nanoseconds  and  the  physical  width  of  the  spectral 
range  In  nanometers,  are  not  present  in  the  SDT  format,  so  the 
software  provides  an  interface  for  the  user  to  specify  these 
values  (time  range,  starting  wavelength,  and  channel  width). 
Reasonable  defaults  are  provided — our  time  range  is  fixed  at 
12.5  ns,  and  channel  width  is  typically  10  nm.  Since  the  start¬ 
ing  wavelength  can  vary,  however,  Slim  Plotter  looks  at  the 
file  name — if  the  user  opted  to  include  the  starting  wavelength 
as  part  of  the  file  name  (e.g.,  783-890-PML16-440nm-240sec- 
c.sdt  is  440  nm),  it  uses  the  indicated  value;  otherwise,  it 
defaults  to  400  nm  unless  the  user  overrides  the  value. 

3.2.3  Visualization 

One  challenge  of  combined  spectral  lifetime  data  is  that  the 
sheer  dimensionality  of  the  data  makes  it  impossible  to  show 
the  entire  raw  data  set  at  once  in  a  comprehensible  fashion. 
Slim  Plotter  addresses  this  difficulty  with  a  two-pronged  ap¬ 
proach:  a  2-D  image  view  showing  an  overview  of  the  data. 


with  the  ability  to  target  a  specific  region  of  interest  (ROI), 
and  a  3-D  plot  focusing  on  the  targeted  region’s  details  (Fig. 
6). 

The  2-D  image  view  on  the  right  shows  an  intensity  image 
for  each  spectral  channel  (see  Fig.  6).  Such  intensity  images 
are  not  directly  recorded  In  the  SDT  files,  but  Slim  Plotter 
computes  them  by  summing  each  lifetime  histogram  to  pro¬ 
duce  a  corresponding  aggregate  intensity  value  for  each  pixel. 
The  slider  directly  beneath  the  image  controls  which  channel 
is  currently  visible  in  the  display,  and  Slim  Plotter  begins  with 
the  brightest  channel  selected.  The  user  can  control  the  2-D 
view’s  brightness  and  contrast  using  “min”  and  “max”  sliders 
beneath  the  channel  selector,  which  control  the  image’s  black 
level  and  white  level,  respectively. 

The  left  plot  shows  a  sum  of  lifetime  decay  curves  (histo¬ 
grams)  for  each  channel  (see  Fig.  6).  The  data  is  rendered  as 
a  surface  in  3-D,  with  the  x  and  z  axes  corresponding  to  the 
histogram’s  excitation  time  and  photon  count,  respectively, 
and  the  y  axis  varying  across  wavelength.  The  program  be¬ 
haves  similarly  for  single-channel  lifetime  data,  but  uses  a 

2- D  line  plot  for  the  lifetime  histogram,  rather  than  a  3-D 
surface.  The  limitation  of  this  view  is  that  it  shows  only  one 
decay  curve  per  channel,  with  no  facility  for  differentiating 
between  spatial  locations  (pixels)  within  the  image.  To  miti¬ 
gate  this  issue,  the  user  can  select  a  ROI  by  dragging  the 
mouse  In  the  2-D  image  view,  the  pixels  are  summed  and  the 

3- D  surface  view  displays  the  totals.  In  this  fashion,  the  in¬ 
vestigator  can  study  lifetime  and  spectral  properties  within  a 
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specific  structure  of  the  sample.  The  3-D  view  initially  dis¬ 
plays  a  sum  of  all  pixels.  The  user  can  narrow  the  focus  by 
encircling  a  region,  or  even  clicking  on  an  individual  pixel. 
The  text  directly  above  the  3-D  display  indicates  the  number 
and  percentage  of  pixels  currently  being  summed. 

Initially,  the  height  of  the  surface  is  scaled  to  fit  the  screen. 
As  such,  it  can  sometimes  be  difficult  to  study  weaker  chan¬ 
nels  when  one  channel  dominates  In  Intensity.  Slim  Plotter 
allows  toggling  of  individual  channels  using  the  check  box 
next  to  the  slider  beneath  the  right  plot.  The  program 
smoothes  over  any  deactivated  channels  in  the  surface.  It  is 
also  possible  to  fix  the  z-scale  range  to  an  absolute  value  by 
checking  the  Z  Scale  Override  check  box  and  changing  the 
value  of  the  adjacent  text  field.  Furthermore,  the  z  axis  can  be 
configured  to  use  a  log  scale  rather  than  the  default  linear  one 
by  clicking  the  Log  radio  button  in  the  Scale  options. 

To  ease  discrimination  between  differing  intensity  values, 
the  3-D  surface  is  colored  according  to  a  lookup  table  (LUT). 
The  default  table  ranges  from  blue  at  low  levels  through  the 
color  spectrum  to  red  at  high  levels,  but  the  table  can  be 
customized  to  provide  an  alternative  color  scheme.  The  LUTs 
button  allows  selection  of  a  number  of  preset  color  tables, 
including  hue,  black-to-red,  black-to-green,  black-to-blue, 
black-to-magenta,  black-to-cyan,  black-to-yellow,  grayscale 
(black-to-white),  fire/heat,  and  ice/cold.  The  user  can  also  opt 
to  adjust  the  red,  green,  and  blue  color  component  lines  manu¬ 
ally  by  drawing  with  the  mouse.  Additionally,  the  current 
color  table  can  be  saved  for  later  retrieval  to  a  file  in  a  simple 
binary  format  compatible  with  the  popular  Image!  program 
(http://rsb.lnfo.nih.gov/ij/).  Last,  by  default,  the  color  table  is 
automatically  scaled  such  that  the  smallest  value  in  the  sur¬ 
face  corresponds  to  the  leftmost  color  in  the  table,  and  the 
largest  value  matches  the  rightmost  color.  However,  at  times, 
it  is  useful  to  associate  particular  colors  with  absolute  values; 
Slim  Plotter  enables  this  behavior  with  the  check  box  inside 
the  color  controls  and  the  two  text  fields  corresponding  to  the 
minimum  and  maximum  absolute  counts. 

There  are  a  few  additional  visualization  options,  mostly 
regarding  the  3-D  surface  view.  First,  instead  of  a  surface,  the 
data  can  be  rendered  as  a  series  of  line  graphs,  one  per  chan¬ 
nel,  by  clicking  the  Lines  radio  button  in  the  Data  options. 
Second,  instead  of  the  usual  perspective  display  projection, 
the  program  can  also  show  a  parallel  projection  mode,  which 
results  in  structures  along  each  axis  neatly  aligned  for  com¬ 
parison.  Third,  the  visibility  of  various  components  within  the 
display  can  be  toggled,  including  the  bounding  box,  the  scale 
bars,  and  the  data  itself,  by  using  the  check  boxes  in  the  Show 
options.  Last,  the  layout  of  the  displays  can  be  rearranged 
using  the  left  and  right  arrow  buttons  surrounding  the  2-D 
view  section:  clicking  the  left  arrow  moves  the  2-D  view  to 
the  left  side  of  the  window,  while  clicking  the  right  arrow 
causes  the  2-D  view  to  break  away  into  its  own  separate  win¬ 
dow. 


3.2.4  Lifetime  curve  fitting 

In  practice,  it  is  expected  that  the  lifetime  histograms  will 
conform  to  an  exponential  decay  pattern  In  the  form  [i.e.,  Eq. 
(1)]: 


y(0  =  2a,exp(-t/Ti)H-c,  (3) 

i=i 

where  n  represents  the  number  of  lifetime  components,  typi¬ 
cally  between  1  and  3;  a  is  the  scaling  factor  for  each  com¬ 
ponent;  c  is  a  background  correction  factor  or  offset;  and  t 
corresponds  to  the  expected  excited  state  lifetime  per  compo¬ 
nent  for  the  region  under  analysis. 

At  present.  Slim  Plotter  can  fit  single-exponential  curves  to 
the  lifetime  data,  to  determine  an  approximation  of  the  aggre¬ 
gate  lifetime  value  per  channel.  It  uses  the  Levenberg- 
Marquardt  least-squares  curve  fitting  algorithm  (LMA)  with 
the  help  of  Janne  Holopainen’s  L-M  fit  package  (http:// 
users.utu.fi/jaolho/).  To  use  the  curve  fitting  feature,  the  Align 
Peaks  option  must  be  checked  when  the  data  is  first  read  (see 
Sec.  3.2.5).  The  program  log  located  below  the  2-D  view 
shows  the  exact  parameter  values  of  each  channel’s  fitted 
curve  as  they  are  computed,  and  the  text  above  the  left  plot 
details  the  minimum  and  maximum  aggregate  lifetime  values 
across  all  channels. 

The  curves  are  shown  superimposed  as  lines  over  the  data 
surface  in  3-D,  making  it  easy  to  verify  their  accuracy.  The 
program  also  allows  visualization  of  the  residuals  (differences 
between  expected  and  actual  data  values)  as  lines.  Similar  to 
the  data  itself,  the  visibility  of  both  the  fitted  curves  and  the 
residuals  can  be  toggled  Individually  using  their  respective 
check  boxes  in  the  Show  options.  In  addition,  the  fitted  data 
or  the  residuals  can  be  shown  as  surfaces  rather  than  lines, 
using  the  corresponding  Surface  radio  buttons. 

The  default  colorlzation  of  the  3-D  surface  data  corre¬ 
sponds  to  surface  height;  however,  if  Slim  Plotter  performs 
curve  fitting,  the  user  can  click  the  Lifetime  radio  button  in 
the  Colors  options  to  colorize  the  surface  instead,  based  on 
each  channel’s  aggregate  lifetime  (r)  value,  producing  a 
striped  result  illustrating  lifetime  differences  between  chan¬ 
nels.  The  rules  described  earlier  for  colorizing  the  surface 
based  on  height  apply  equally  when  visualizing  color  accord¬ 
ing  to  lifetime  values. 

One  last  option  that  is  occasionally  useful  to  improve  the 
quality  of  the  curve  fit  result  is  the  Cut  1 .5  ns  From  Fit  check 
box  on  the  initial  confirmation  screen,  enabled  by  default. 
This  option  disregards  the  last  1.5  ns  of  histogram  data  when 
performing  curve  fitting,  to  compensate  for  the  fact  that  our 
system  sometimes  records  a  sudden  drop  in  photon  counts  at 
the  tail  end  of  the  lifetime  histogram — and  the  tail  values  are 
less  important  to  obtain  an  accurate  fit  regardless. 

3.2.5  Calibration 

Ideally,  everything  would  line  up  perfectly  during  collection 
of  spectral  lifetime  data,  with  an  instant  system  response  time, 
or  at  least  an  equivalent  system  response  delay  at  each  chan¬ 
nel.  In  practice,  however,  system  response  skew  across  chan¬ 
nels  is  one  of  several  practical  complications  that  is  associated 
with  a  functional  spectral  lifetime  acquisition  system.  Slim 
Plotter  utilizes  an  algorithm  to  correct  for  slight  discrepancies 
in  the  system  response  time  between  channels:  at  each  chan¬ 
nel,  the  software  looks  for  the  histogram’s  highest  value — 
which  should  correspond  to  the  peak  of  the  lifetime  decay 
curve — and  “pushes  forward”  individual  channels  until  they 
all  line  up.  In  other  words,  the  program  pads  these  channels 
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with  zeroes  so  that  the  channels’  decay  curve  peaks  coincide 
with  one  another.  The  program  log  outputs  the  results  of  this 
alignment  when  the  main  window  first  appears.  Unchecking 
the  Align  Peaks  check  box  on  the  initial  confirmation  screen 
disables  this  behavior,  but  Slim  Plotter  will  not  perform  ex¬ 
ponential  curve  fitting  unless  it  is  allowed  to  align  the  peaks. 

When  calibrating  a  spectral  lifetime  system,  it  is  useful  for 
the  hardware  engineer  to  perform  an  acquisition  with  a  second 
harmonic  source  (as  opposed  to  a  fluorescence  sample),  which 
has  essentially  zero  lifetime.  Any  measured  lifetime  would 
therefore  be  the  system  response.  This  response  function  can 
be  used  to  deconvolve  the  fluorescence  decay  curves  so  as  to 
correct  for  the  effects  of  the  finite  instrument  response.  Slim 
Plotter  is  also  capable  of  analyzing  these  system  response  files 
by  computing  and  visualizing  the  full  width  at  half  maximum 
(FWHM)  values  for  each  channel’s  lifetime  histogram.  Since 
this  option  is  mainly  useful  for  analyzing  system  response,  it 
is  off  by  default,  but  it  can  be  enabled  by  checking  the  Com¬ 
pute  FWHMs  check  box  on  the  initial  confirmation  screen.  If 
enabled.  Slim  Plotter  shows  the  FWHMs  as  green  lines  in  the 
3-D  surface  view,  and  their  visibility  can  be  toggled  using  the 
FWHMs  checkbox  in  the  Show  options. 

3.2.6  Data  export 

The  lifetime  histograms  currently  being  viewed  can  be  ex¬ 
ported  for  further  processing  in  another  program,  using  the 
Export  button  in  the  3-D  view  controls.  Slim  Plotter  writes  the 
data  to  a  text  file  in  a  simple  comma-separated  values  (CSV) 
format,  which  can  be  easily  imported  into  any  numeric 
spreadsheet  application. 

3.2.7  Slim  Plotter  future  directions 

There  are  a  number  of  improvements  we  are  planning  to  Slim 
Plotter  to  provide  more  effective  analysis  of  combined  spec¬ 
tral  lifetime  data  sets: 

•  Integrated  VisBio  environment.  As  part  of  a  larger  de¬ 
velopment  effort  across  our  Java  software,  we  are  creating  a 
standardized  infrastructure  of  modular  components  for  data 
I/O,  metadata  handling,  visualization,  and  analysis.  We  plan  to 
integrate  SLIM  Plotter  further  into  this  infrastructure,  allow¬ 
ing  it  to  utilize  these  modularized  components  and  to  be 
called  as  a  modular  application  itself  from  other  applications. 

•  Multiexponential  eurve  fitting.  Slim  Plotter  currently 
fits  only  single-exponential  lifetime  curves.  We  would  like  to 
extend  this  functionality  to  support  two-  and  three-component 
fits,  since  there  are  often  multiple  major  lifetime  components 
within  the  sample,  and  being  able  to  differentiate  between 
them  is  critical. 

•  Channel  binning  and  SDT  export.  SPCImage  comple¬ 
ments  Slim  Plotter  nicely  for  lifetime  analysis,  but  SPCImage 
does  not  include  much  support  for  multispectral  data.  As  such, 
it  would  be  valuable  for  Slim  Plotter  to  be  able  to  produce 
output  SDT  files  with  multiple  channels  binned  into  one,  for 
use  with  SPCImage’s  more  sophisticated  curve  fitting  routine. 

•  Improved  file  format.  The  SDT  format  has  a  number  of 
shortcomings — e.g.,  the  inability  to  embed  time  range,  start¬ 
ing  wavelength,  and  channel  width  into  the  file  as  metadata — 
and  is  somewhat  proprietary  in  nature.  We  are  developing  an 
open  format  for  storing  spectral  lifetime  data  based  on  Hei- 
rarchical  data  format  (HDF)  and  using  the  OME-XML  data 


model,^°  which  both  our  acquisition  system  itself  and  Slim 
Plotter  will  support  via  Bio-Formats. 

•  Configurability.  Slim  Plotter  would  benefit  from  greater 
configurability.  For  example,  certain  parameters  such  as 
whether  to  align  the  lifetime  decay  curve  peaks  must  be  set 
when  Slim  Plotter  first  starts,  and  the  alignment  cannot  be 
toggled  or  configured  afterward.  Similarly,  the  lifetime  curve 
fitting  routine  itself  could  benefit  from  a  greater  number  of 
options,  such  as  SPCImage’s  ability  to  “lock  down”  certain 
parameters  or  adjust  the  optional  1.5-ns  cutoff. 

•  Lifetime  ealibration.  The  hardware  engineer  can  collect 
a  system  response  file  that  represents  the  instrument’s  behav¬ 
ior  when  no  excitation  is  taking  place.  Slim  Plotter  should  use 
this  file  to  adjust  the  lifetime  histograms — by  subtracting  out 
the  response  values — to  improve  the  quality  of  the  fits  it  gen¬ 
erates. 

•  Spectral  calibration.  Similar  to  how  the  system  re¬ 
sponse  time  differs  between  spectral  channels,  creating  bias, 
there  is  an  expected  intensity  distribution  across  channels  that 
is  not  always  confluent  with  reality.  Slim  Plotter  should  also 
calibrate  for  such  system  bias  to  improve  spectra-related  mea¬ 
surements. 

•  Emission  spectrum.  The  emission  spectrum  consists  of 
all  lifetime  bins  and  pixels  summed  for  each  channel,  plotted 
in  2-D  as  a  line  graph;  Slim  Plotter  should  provide  an  option 
for  this  view. 

•  Alternate  visualization  modes.  Slim  Plotter  would  ben¬ 
efit  from  additional  methods  of  visualizing  the  data.  For  ex¬ 
ample,  a  “spectral  projection”  view  could  consist  of  linearly 
mapping  each  channel  into  a  position  along  the  visible  spec¬ 
trum  (similar  to  hue),  colorizing  accordingly,  and  then  per¬ 
forming  a  maximum  intensity  projection  while  preserving  the 
colorization.  Slim  Plotter  could  also  include  the  ability  to  col¬ 
orize  the  2-D  view  according  to  each  pixel’s  lifetime  by  com¬ 
puting  the  lifetime  around  that  pixel  to  a  particular  radius; 
such  a  computation  is  expensive  but  can  be  very  informative. 

In  conclusion,  we  find  that  combined  spectral  lifetime  im¬ 
aging  has  great  utility  for  mitigating  the  traditional  complica¬ 
tions  presented  by  endogenous  fluorescence  and  allowing  the 
scientist  to  fully  exploit  the  power  of  fluorescence  microscopy 
to  record  and  characterize  introduced  and  native  fluorophores 
in  vivo.  This  power  of  SLIM  is  demonstrated  quite  effectively 
in  breast  cancer,  where  many  of  the  key  players  in  cancer 
invasion  and  progression  are  intrinsically  fluorescent,  and 
tagged  fluorescent  constructs  for  many  important  signaling 
molecules  have  been  developed.  Rather  than  having  to  image 
the  endogenous  and  exogenous  fluorescence  separately,  as  of¬ 
ten  is  done,  SLIM  allows  for  simultaneous  acquisition  and 
effective  discrimination.  SLIM  will  be  advanced  greatly  as 
photon  counting  techniques  improve  with  the  development  of 
faster  photon  counting  electronics,  more  sensitive  multi-anode 
detectors,  and  improved  analysis  software  for  curve  fitting. 
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